Baseline and triangulation geometry in a standard plenoptic camera

In this paper, we demonstrate light field triangulation to determine depth distances and baselines in a plenoptic camera. The advancement of micro lenses and image sensors enabled plenoptic cameras to capture a scene from different viewpoints with sufficient spatial resolution. While object distances can be inferred from disparities in a stereo viewpoint pair using triangulation, this concept remains ambiguous when applied in case of plenoptic cameras. We present a geometrical light field model allowing the triangulation to be applied to a plenoptic camera in order to predict object distances or to specify baselines as desired. It is shown that distance estimates from our novel method match those of real objects placed in front of the camera. Additional benchmark tests with an optical design software further validate the model’s accuracy with deviations of less than 0:33 % for several main lens types and focus settings. A variety of applications in the automotive and robotics field can benefit from this estimation model

Onset Rivalry: Brief Presentation Isolates an Early Independent Phase of Perceptual Competition

When the left and right eyes are simultaneously presented with different images, observers typically report exclusive awareness of only one image. This phenomenon is termed binocular rivalry, reflecting the fact that the dominant image alternates every few seconds in a cycle of perceptual competition that continues indefinitely. Despite the apparent continuity in perceptual switching, we now demonstrate that the initial “onset” period is fundamentally different to all subsequent rivalry epochs. Using brief intermittent presentations, rivalry dominance shows strong biases such that the same target is perceived with each successive stimulus onset. These biases remain consistent within any given location, but vary across the visual field in a distribution that is stable over multiple weeks but highly idiosyncratic across observers. If the presentation exceeds ∼1sec at any location, however, the very different and much more balanced alternations of sustained binocular rivalry become apparent. These powerful onset biases are observed with brief intermittent presentations at a single location or with continual smooth motion of the targets. Periods of adaptation to one of the rivaling targets induced local switches in dominance to the non-adapted target. However, these effects were generally limited to the spatial site of adaptation and had less influence over each subsequent cycle of the target. We conclude that onset rivalry is independent of sustained rivalry and cannot be explained by local regions of monocular dominance or memory of past perceptual history, but rather reflects low-level, spatially localized factors that are stable over periods of weeks. These findings suggest that brief presentation paradigms are inappropriate for their current use in studies of the mechanisms underlying sustained rivalry. However, brief presentations are ideal for investigating early stages of perceptual competition

Duality in Binocular Rivalry: Distinct Sensitivity of Percept Sequence and Percept Duration to Imbalance between Monocular Stimuli

Visual perception is usually stable and accurate. However, when the two eyes are simultaneously presented with conflicting stimuli, perception falls into a sequence of spontaneous alternations, switching between one stimulus and the other every few seconds. Known as binocular rivalry, this visual illusion decouples subjective experience from physical stimulation and provides a unique opportunity to study the neural correlates of consciousness. The temporal properties of this alternating perception have been intensively investigated for decades, yet the relationship between two fundamental properties - the sequence of percepts and the duration of each percept - remains largely unexplored

Contrast and Phase Combination in Binocular Vision

BACKGROUND: How the visual system combines information from the two eyes to form a unitary binocular representation of the external world is a fundamental question in vision science that has been the focus of many psychophysical and physiological investigations. Ding & Sperling (2006) measured perceived phase of the cyclopean image, and developed a binocular combination model in which each eye exerts gain control on the other eye's signal and over the other eye's gain control. Critically, the relative phase of the monocular sine-waves plays a central role. METHODOLOGY/PRINCIPAL FINDINGS: We used the Ding-Sperling paradigm but measured both the perceived contrast and phase of cyclopean images in three hundred and eighty combinations of base contrast, interocular contrast ratio, eye origin of the probe, and interocular phase difference. We found that the perceived contrast of the cyclopean image was independent of the relative phase of the two monocular gratings, although the perceived phase depended on the relative phase and contrast ratio of the monocular images. We developed a new multi-pathway contrast-gain control model (MCM) that elaborates the Ding-Sperling binocular combination model in two ways: (1) phase and contrast of the cyclopean images are computed in separate pathways, although with shared cross-eye contrast-gain control; and (2) phase-independent local energy from the two monocular images are used in binocular contrast combination. With three free parameters, the model yielded an excellent account of data from all the experimental conditions. CONCLUSIONS/SIGNIFICANCE: Binocular phase combination depends on the relative phase and contrast ratio of the monocular images but binocular contrast combination is phase-invariant. Our findings suggest the involvement of at least two separate pathways in binocular combination

Willpower and Conscious Percept: Volitional Switching in Binocular Rivalry

When dissimilar images are presented to the left and right eyes, awareness switches spontaneously between the two images, such that one of the images is suppressed from awareness while the other is perceptually dominant. For over 170 years, it has been accepted that even though the periods of dominance are subject to attentional processes, we have no inherent control over perceptual switching. Here, we revisit this issue in response to evidence that top-down attention can target perceptually suppressed ‘vision for action’ representations in the dorsal stream. We investigated volitional control over rivalry between apparent motion (AM), drifting (DM) and stationary (ST) grating pairs. Observers demonstrated a remarkable ability to generate intentional switches in the AM and D conditions, but not in the ST condition. Corresponding switches in the pursuit direction of optokinetic nystagmus verified this finding objectively. We showed it is unlikely that intentional perceptual switches were triggered by saccadic eye movements, because their frequency was reduced substantially in the volitional condition and did not change around the time of perceptual switches. Hence, we propose that synergy between dorsal and ventral stream representations provides the missing link in establishing volitional control over rivalrous conscious percepts

Color afterimages in autistic adults

It has been suggested that attenuated adaptation to visual stimuli in autism is the result of atypical perceptual priors (e.g., Pellicano and Burr in Trends Cogn Sci 16(10):504–510, 2012. doi:10.​1016/​j.​tics.​2012.​08.​009). This study investigated adaptation to color in autistic adults, measuring both strength of afterimage and the influence of top-down knowledge. We found no difference in color afterimage strength between autistic and typical adults. Effects of top-down knowledge on afterimage intensity shown by Lupyan (Acta Psychol 161:117–130, 2015. doi:10.​1016/​j.​actpsy.​2015.​08.​006) were not replicated for either group. This study finds intact color adaptation in autistic adults. This is in contrast to findings of attenuated adaptation to faces and numerosity in autistic children. Future research should investigate the possibility of developmental differences in adaptation and further examine top-down effects on adaptation

How to Join a Wave: Decision-Making Processes in Shimmering Behavior of Giant Honeybees (Apis dorsata)

Shimmering is a collective defence behaviour in Giant honeybees (Apis dorsata) whereby individual bees flip their abdomen upwards, producing Mexican wave-like patterns on the nest surface. Bucket bridging has been used to explain the spread of information in a chain of members including three testable concepts: first, linearity assumes that individual “agent bees” that participate in the wave will be affected preferentially from the side of wave origin. The directed-trigger hypothesis addresses the coincidence of the individual property of trigger direction with the collective property of wave direction. Second, continuity describes the transfer of information without being stopped, delayed or re-routed. The active-neighbours hypothesis assumes coincidence between the direction of the majority of shimmering-active neighbours and the trigger direction of the agents. Third, the graduality hypothesis refers to the interaction between an agent and her active neighbours, assuming a proportional relationship in the strength of abdomen flipping of the agent and her previously active neighbours. Shimmering waves provoked by dummy wasps were recorded with high-resolution video cameras. Individual bees were identified by 3D-image analysis, and their strength of abdominal flipping was assessed by pixel-based luminance changes in sequential frames. For each agent, the directedness of wave propagation was based on wave direction, trigger direction, and the direction of the majority of shimmering-active neighbours. The data supported the bucket bridging hypothesis, but only for a small proportion of agents: linearity was confirmed for 2.5%, continuity for 11.3% and graduality for 0.4% of surface bees (but in 2.6% of those agents with high wave-strength levels). The complimentary part of 90% of surface bees did not conform to bucket bridging. This fuzziness is discussed in terms of self-organisation and evolutionary adaptedness in Giant honeybee colonies to respond to rapidly changing threats such as predatory wasps scanning in front of the nest

A Reaction-Diffusion Model to Capture Disparity Selectivity in Primary Visual Cortex

Decades of experimental studies are available on disparity selective cells in visual cortex of macaque and cat. Recently, local disparity map for iso-orientation sites for near-vertical edge preference is reported in area 18 of cat visual cortex. No experiment is yet reported on complete disparity map in V1. Disparity map for layer IV in V1 can provide insight into how disparity selective complex cell receptive field is organized from simple cell subunits. Though substantial amounts of experimental data on disparity selective cells is available, no model on receptive field development of such cells or disparity map development exists in literature. We model disparity selectivity in layer IV of cat V1 using a reaction-diffusion two-eye paradigm. In this model, the wiring between LGN and cortical layer IV is determined by resource an LGN cell has for supporting connections to cortical cells and competition for target space in layer IV. While competing for target space, the same type of LGN cells, irrespective of whether it belongs to left-eye-specific or right-eye-specific LGN layer, cooperate with each other while trying to push off the other type. Our model captures realistic 2D disparity selective simple cell receptive fields, their response properties and disparity map along with orientation and ocular dominance maps. There is lack of correlation between ocular dominance and disparity selectivity at the cell population level. At the map level, disparity selectivity topography is not random but weakly clustered for similar preferred disparities. This is similar to the experimental result reported for macaque. The details of weakly clustered disparity selectivity map in V1 indicate two types of complex cell receptive field organization